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19. IDW-S - SAMNet ICD 

20. IDW-S ACS ICD VI 

21 . IDW-S System Security Plan -S 

22. Maintenance Manual 

23. Materials Request Policy 

24. Performance Monitoring and Measurements 

25. Privileged Users Guide 

26. Project Management Plan 

27. RetrievalWare - Analyst Update Course 

28. System Administrators Guide 

29. System Administrators Manual 

30. Test and Evaluation Test Analysis Report 

3 1 . Training Evaluation Plan 

32. Training Management Plan 

33. User Support Manual 

34. Users Reference Guide 

35. Violent Gang and Terrorist Organization File (VGTOF) ICD 
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Data Type 

Media 

Frequency 

Intel Plus 

FTP 

Weekly 

JICI 

N/A 

One-time 

SAMNet 

FTP 

3X Daily 

Open Source 

CD 

Daily 

VGTOF 

CD 

Weekly 


Table 5-1 IDW Data Ingest Type, Media and Frequency 


ALL IIJFORHATIOH COIJTAIHED 

HEKEIH IS UUCLASSIFIED 

DATE 08-02-2007 BY 65179 DHH/BJA/CAL 



(ITOD) (FBI) 


From; I ~k lTOD) (FBI) 

Sent: Thursday, September 21, 2006 5:37 PM , , 

To: STACY-R OSE. FREIDA T. OTOD) (FBI); JOLMA, LAWRENCE N. (ITOD)(FBI);[ T I b 6 

[___J(lTOD)(FBI); PATON, THOMAS M. (ITOD)(FBI); FERGUSON, RICHARD A. (iTODbvc 
(FBI): GOLDSWORTHY, ABRAM C. nTOD)(FBI); WHITE, J ERRY T. (WE) (FBI); 

SCHWARTZ, RONALD (ITOD)(FBI); r I (ITOD) (FBI); SPENCER, 

JAMES A. (ITOD)(FBI); ROBERTS, THOMAS J . (ITOD)(FBI): M CCANN. O WEN (ITOD1 
fFRlv SHO RT EILEEN F. (ITOD) (FBI); PRICE. I K ITOD) (FBI) i I 

l OTODI (FBI); SCAVONGELLI, GAIL (ITOD) (FBI); SANCHEZ, JENNIF ER R. b6 
nTODKFBIV SINGER, NAOMI E. (ITOD)(FBI); MORGAN, LEO T. Ill (ITOD)(FBI): r b7C 

I IfITODWFBn: S MITH. LESLIE J. (ITOD)(FBI); SHORT, JAMES E. JR (ITOD) 

fFRI II I dTODI (FBI); BROOK S. JULIUS J. (ITOD) (FBI): M ORIN. PAUL 

A. (ITOD)(FBI); REINER, STEVEN E (ITOD) (FBl H I NE) (FBI); 

STEFANSSON, KAREN M. OTODUFBl U l (ITOD)(FBI): SNELLINGS. 

RICHARD (ITOD) (F BO , 

Cc: I I (ITOD) (FBI); GRAY. SHAWN E. (ITOD) (FBI): I 

TTODKFBl) 

Subject: INVESTIGATIVE DATA WAREHOUSE (IDW) 


UNCLASSIFIED all imforkation comtaiiied 

NON-RECORD HEREIN IS UNCLASSIFIED 

DAIX 08-02-2007 BY 65179 DHH/BJA/CAL 


ITOD Section Chiefs/Unit Chiefs: 


Within the next 30 days, an Operational Readiness Review (ORR) will take place for the 
INVESTIGATIVE DATA WAREHOUSE (IDW) Project. At th is particular time, the date of the ORR has no t been 
determined. IDW documention has been placed on the S drive unde < Ifor b2 

your review. As soon as possible, please make an effort to review the IDW documents that refer to your area of b7E 
expertise. IDW has been following the Lifecycle Management Directive fLCMDf throughout the Lifecycle of the project. 


If you are unfamiliar with IDW, please see the description of IDW below. 

Description of IDW: 

Investigative Data Warehouse (IDW) - IDW is developed by Office of the Chief Technology Officer. IDW 
enables users to perform very flexible searches simultaneously across multiple databases such as ACS (ECF), 
Intelligence Community cable messages, and selected major counterterrorism IntelPlus file rooms. Users are 
primarily from the Counter-Terrorism Division and Field Intelligence Groups. Through the BDW Special Projects 
page, created with the cooperation of the Counterterrorism Division (CTD), users can search additional sources, 
including all CIA Intelligence Information Reports (HR) sent to the FBI f rom 1978 to present, selected te rrorism 
watch lists, and several databases provided by other federal agencies (e g, b 2 


Thank You!!! 


1 1 DU I fflnsirion Man agamen^ Unit (TMU) 
Room 9483, (202) 32^ 
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ITOD Transition Management Unit 
Executive Dashboard 


Month of: September ’06’ 


ft Improving 4*^ Steady Deteriorating 

Overall Rlsks^ High Low 

"Criticality - defined by customer 

High Medium ^ Low 

* "Complexity - Choose one 
H - High M - Medium L - Low 


Transition Projects Scorecard 


On plan : 
At risk i 


Issues w/plan 
No status 


ITOD 

Program Project Name/ LCMD 
Component Gate 


ORR 

Date 

Est. 


Transitioi 

Period 






5.IDW 


6/1/06 


12/30/06 


H 


m 


h2 

b7E 
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I Customer Relationship Services Program 
DAS Data Access Services Program 
8881 E-Government Services Program 
ISS Information Sharing Services Program 

I Network and Communication Services Program 
[ System Enhancement and Software Support Services Program 


lim Vulnerability Management Services Program 
ITLM Licensing and Maintenance Program 
mm Technology Revitalization Services Program 
iCAM Infrastructure Consolidation and Management Program 
ACR Applications Consolidatjon and Retirement Program 
Administration and Control Program 
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Total Development Costs (including hardware) 


• (To be provided by the Project Manager at a later date) 


• Operations and Maintenance costs arq 


per year. 


Complexity L low M Medium H High 




L 

No interface with other systems 

H 

Subseauent iterations (IDW-S vl.l and V2) will integrate or provide access to| 

-data provided from FINCEN svstemi 









a 

Due to the usage of EDW and the stqjprat of the Counteiterrorism Divisira, Criminal Investigative Diviaon and JTTTF, system 
criticality is deemed high. 
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other Program Updates: IDW Statistics 

Documents in IDW 

• 434,638,628 “unique” documents (up from 434,548,739) 

697,728,261 available documents (up from 697,615,952 ) 


IDW DOCUMENTS 


700 . 000 . 000 

650 . 000 . 000 

600 . 000 . 000 

550 . 000 . 000 -J 

500 . 000 . 000 

450 . 000 . 000 

400 . 000 . 000 

350 . 000 . 000 







TOTAL UNIQUE Documents TOTAL Available Unique + Non-Unique 
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IDW-S V1.2 Data Collections as of August 27, 2005 


Change Notes: 

(i) 


^Reports Collection was released on the IDW-S V1 .2 


The 

Core and taken off the IDW-S SPT Subsystem on August 27, 2005. 

1. Automated Case System (ACS^ Electronic Case File (ECFI - This data set 

contains copies of the ECs, FD-302S, Facsimiles, FD-542s, Inserts, Transcriptions, 
Teletypes, Letter Head Memorandums (LHM), Memorandums and other FBI 

documents contained w ithin ACS/ECF for all but the following FBI case 

classification violations/ 


b2 

b7E 


b2 


jThe files are updated daily. 


2. CIA Intelligence Information Reports fHR-CIA> : Electronic copies of all CIA non- 
TS/non-SCI Intelligence Information Reports (lIRs) and Technical Disseminations 
(TDs) from 1 978 to MAY 2004. These files are not updated. 

3. IntelPlusI iFileroom - This data set contains copies of 


scanned pages and their correspondin g OCR text files related to an FBI 

|investigation o | I Updated 


periooicaiiy. 


b2 

b6 
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4. lntelPlus _ 


Fileroom - This data set contains 


copies of scanned pages and their corresponding OCR text files related to multiple 
FBI field office data regarding the terrorist activities involvind I 

I Updated 


periodically. 
IntelPlusf 


iFileroom - This data set contai ns copies of s canned pages 


and their corresponding OCR text files related to th^ 
Updated periodically. 

IntelPlusf 


nvestigation. 


b2 
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7. 


8 . 


J Fileroom - This data set contains copies of sc anned oaoes and their 
corresponding OCR text files related to an FB| Investigation of 

Updated periodically. 

IntelPlusI IFileroom - This data set c ontains copies of scanned 


b2 

b7E 


pages and their corresponding OCR text files related tf 
and provided to the FBI. Updated periodically. 

IntelPluj IFileroom - This data set contains copies of scanned 

pages and their corresponding OCR text files related to acts of domestic terrorism, 
such as the April 19, 1995 Oklahoma City Bombing (Okbom). Updated periodically. 


b2 
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*** LAW ENFORCEMENT SENSITIVE - DO NOT DISTRIBUTE OUTSIDE OF FBI 


9. IntelPlud Fileroom - This data set contains copi es of scanned 

^nnes and their corresponding OCR text files collected bv the FBI’J ^ 

I | . Updated periodically. 


1 0. IntelPlusl iFileroom - This data set contains c opies of scanned pages an d 

their corresponding OCR text files related to Al Qaedd 


Updated periodically. 


1 1 ■ IntelPlusC 


iFileroom - This data set contains copies 


nf srannfiH nanfls and thflir rnrrR.snnndinn Oi 


12.lntelPlus 


JR text files related to an FBI 
Updated periodically. 


Fileroom - This data set contains copies of scanned pages 


and their corresponding OCR text files related to an FBl| [investigation of the 
I ~t The data, once received will be updated 

periodically, preferably daily. 


1 3. IntelPlus} Inieroom - This data set 

contains copies of scanne d pages and their corresponding OCR text files related to 
I [ from all 56 FBI field divisions and other agencies. 

Updated periodically. 


b2 
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b2 

b7E 
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14. Joint Intelligence Committee Investigation fJICI) - Scanned copies and their 
corresponding OCR text files of all FBI documents related to extremist Islamic 
terrorism between 1993 and 2002. These files are not updated. 


15. Open Source News - Various foreign news sources that have been translated into 
English, as well as a few large U.S. publications, such as the Washington Post. 
These files are updated daily. 


16. Secure Automated Messaging Network (SAMNet) - SAMNet consists of 

messaging traffic that is sent between different U.S. Government agencies through 
the Automated Digital Information Network (AutoDIN), including Intelligence 
Information Reports (lIRs) and Technical Disseminations (TD) from the FBI, 

Central Intelligence Agency (CIA), Defense Intelligence Agency (DIA), and others 
from November of 2002 to present. IDW receives copies of these classified 
messages up to SECRET with no SCI caveats. These files are updated daily. 

1/ 1 l-Thij bata set contains copies of 

reports regardingl 1 


1 8. Violent Gang and Terrorist Organization File fVGTOF) - Lists of individuals and 
organizations associated with violent gangs and terrorism, provided by the FBI 
National Crime Information Center (NCIC). This file is updated monthly. 
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Concept of Operation - Data 


• CORE library documents 

- ~ 42.3 M unstructured documents in 17 collections 

- ACS ECF; Updated daily 

- IntelPlus (1 1 Filerooms); Updated when provided 

- SAMNet: Updated daily 

- JICI: Static 

- VGTOF: Updated monthly 

- nnPnSniirreNflws: Undated thrice we ekly 


• SPT documents Outside the Scope 

- Sources 
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Core External Data Sources 
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Outside the Scope 




Planned Major Chanaes to Services 











Program 

QA&CM 


- Work is also ongoing to develop and populate an Access database to support the 
property management and configuration management aspects of IDW. 


September 12, 2005 
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Performance Measurement & 
Monitoring (PMM) Manual 


IDW Operation and Maintenance 
N65236-98-A-7092 (DO 6046) 


Baseline Version 1.0 


PMM NG-OM-009.BL1 


Federal Bureau of Investigation 
Information Resources Division 
Data Management Section 



Investigative Data Warehouse (IDW) 
Performance Measurement & Monitoring 
Baseline Version 1.0 
March 15, 2004 


Note: Hardcopy versions of this document must be verified for correct version number with the IDW O&M Document Control Library 
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Performance Measurement & 
Monitoring (PMM) Manual 


IDW Operation and Maintenance 
N65236-98-A-7092 (DO 6046) 


Baseline Version 1.0 


PMMNG-OM-009.BL1 


2 IDW Overview Outside the Scope 

IDW is composed of three distinct sections, ingest, user query and control 


2.1 Ingest 

The ingest function accepts information from external sources, validates the data, and 
formats the data for data storage. 


2.1.1 External Sources 

IDW receives data from, 

• The Automated Case System (ACS) is composed of several applications. These 
applications are Investigative Case Management (ICM), Electronic Case File (ECF) 
and the Universal Index (UNI). IDW uses a subset of the Electronic Case File (ECF 

)■ 

• fntelnlus (CT File roomsI formerly called the 


• Secure Automated Messaging Network (SAMNET) cable traffic messages received 
by the FBI 

• Violent Gang Terrorist Offender File (VGTOF) from Criminal Justice Information 
Systems (CJIS) Division 

• Joint Intelligence Committee Inquiry (JICI) - Paper counter-terrorism files 

• The Open Source Library is collected from global news sources that are either in 
English or have been translated into English 

• I I data received from the 

• Various paper documents including 

o handwritten notes 
o official FBI correspondence 
o intelligence analysis 
o other terrorism related information 


2.1.2 Data Validation 

IDW has been certified to handle data at a Secret level. Any data classified higher than 
Secret cannot exist in IDW. The data validation process verifies that all data to be stored in 


Note: Hardcopy versions of this document must be verified for correct version number with the IDW O&M Document Control Library. 

PMMNG-OM-009.BL1 
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Performance Measurement & 
Monitoring (PMM) Manual 


IDW Operation and Maintenance 
N65236-98-A-7092 (DO 6046) 


Baseline Version 1.0 PMM NG-OM-009.BL1 


IDW meets this security guideline. Data that is questionable is removed from the system, 
and is reviewed. After the reviewer certifies that the data is appropriate for IDW it is 
placed into the IDW databases. 



Note: Hardcopy versions of this document must be verified for correct version number with the IDW O&M Document Control Library 
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Investigative Data Warehouse (IDW) Training 
Federal Bureau of Investigation 
Washington, D.C, 



b. Data Sources : IDW draws its information from the following data sources; 


• ACS; Automated Case Support. (CT Case Files) Archived Investigative dating 
back through calendar year 1995. Updates pushed (FTP) to IDW once per day. 

• Intel Plus: Updates pushed (FTP) to IDW as needed (usually once per day). 







• JICI: Archived data from the Joint Intelligence Committee Investigation (JICI) 
regarding 9/1 1 . (Static file system) 

• ORCON: Parsed data from SAMNet and ACS data collections at this caveat. 

Pushed to IDW once per day. 

• SAMNet: SECRET and below cable traffic to/from FBI Headquarters. Pulled (FTP) 
from SAMNet server (IDW chronological job runs every 10 minutes; SAMNet posts 
new data 3 times per day). 

• TFRG; Terrorist Financial records. Updates pushed (FTP) to IDW once per day. 

• VGTOF: Violent Gang & Terrorist Offense File. Updated data file is provided in 
entirety by CD on a weekly basis. 

• Open Source Research (OSINT): Current from the MiTAP server. 

c. Handling caveats ean apply (here are some examples) - 

b2 
b7E 

LES - Law Enforcement Sensitive 
COMINT - Communications Intelligence 


ORCON - Originator Controlled 


"oreign Nationals 



IDW 




Data Sources 



IDW draws its information from the following data sources: 

ACS: Automated Case Support. Archived Investigative dating back 
through calendar year 1995. (CT Case Files) 

Updates pushed (FTP) to IDW once per day. 

Intel Plus (Updates pushed (FTP) to IDW as needed (once per day) 


Domestic terrorism incidents 
Al Qaeda 

Significant international terrorism incidents 

JICI: Archived data from the Joint Intelligence Committee 
Investigation (JICI) regarding 9/1 1 . (Static file system) 




IDW 


Data Sources (cont) 


ORCON: parsed data from SAMNet and ACS data collections 
at this caveat. Pushed to IDW once per day 

SAMNet: SECRET and below cable traffic to/from FBI 
Headquarters. Pulled (FTP) from SAMNet server (IDW 
chronological job runs every 10 minutes; SAMNet posts 
new data 3 times per day) 

TFRG: Terrorist Financial records 

Updates pushed (FTP) to IDW once per day. 

VGTOF: Violent Gang & Terrorist Offense File Updated 
datafile is provided in entirety by CD on a weekly basis 

Open Source Research (OSINT): Pulled (FTP) from MiTAP 
server daily 


r ollections to search: Select Browse' to view < 

fSekctall collections') rtJnscted alt callgctiorw 


r* ACS ( Bfowsel 


r 

intBl^ 


ft^owsel 

r 

InteN 


( Browsel 

r 

InlelH 



f Browsel 

r 

InfeH 



( Browsel 

r 

InteH 


r Browsel 


r 

Inteh 


f Browsel 



r** JlCi (.Browse) 


r~ ORCON f Browse) 

P Opensource ( Browse'^ 
P SAMNET ( Browse) 

P VGTOF ( Browsel 


collection's frequenUy occurring concepts. 
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Open Source Data Sources 



Addis Ababa Tribune - 

Agenda Brasilia - 

Al-Ahram (Egypt, weekly English 

version) - 

AIIAfrica.com - 

Arabic News - 

Asahi Shimbun - 

Asia Times (Hong Kong) - 

Bangkok Post - 

Christian Science Monitor - 

Crescent International - 

Daily Telegraph (London, 

England) - 

Dawn (Karachi, Pakistan) - 

Debka (Israel) - 

East Africa Daily Nation - 

Gulf News (UAE) - 

Ha'aretz (Israel) - 

IFRC International Federation of 

the Red Cross - 


IRIN Integrated Regional 
Information Network - 
Iraq Press News Agency - 
Islamic Republic News Agency 
(Iran) - 

Jakarta Post - 
Janes - 

Jordan Times - 
L'Osservatore Romano - 
Lagos (Nigeria) Guardian - 
Lahore (Pakistan) Nation - 
Lebanon Daily Star (Beirut) - 
Malaysian Star - 
Manila Bulletin - 
Manila Times - 
Miami Herald - 


IDW 


Open Source Data Sources 



Moscow Times - 
National Post and CP - 
New Straits Times (Kuala 
Lumpur) - 

PETRA (Jordanian News 
Agency) - 

Pakistan Observer (Islamabad) - 
Palestine Chronicle - 
People's Daily (China) - 
Philippine Star - 
Pravda - 

ProMed - epidemiology mail list 
Russian Information Agency 
Novosti - 

Russian Issues (Misc. Russian 
news) - 


Russian Observer - 
SABA (The News Agency of 
Yemen) - 
Saudi Gazette - 
South African Dispatch - 
Sydney Morning Herald - 
Tehran Times - 
Times of India - 
UNHCR UN High 
Commissioner on Refugees 
Ummah News - 
Uzbekistan Report - 
Washington Post - 
XinHua News Service - 
Yemen Times (weekly) - 
Yomiuri Shimbun (Japan) - 
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Federal Bureau of Investigation (FBI) 
Investigative Data Warehouse (IDW) 

Project Management Plan 

June 30, 2005 






IR , ■ 










OF 


iki 

o| $ 

tel 5 






Prepared under Subcontract 04-6844-27 
(Prime Contract N65236-04>D-6844) 
Task Order 0093 


NORTHRO P GRUMMAN 

Technology 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 




Outside the Scope 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 

FBI IDW Program Management Plan IDW-NG-PM-001 .01 .00 



Data ingest functions will be the most frequently performed data administration tasks. As this 
function is primarily tasked to another subcontractor, O&M personnel are not deeply 
knowledgeable of the specific administrative tasks. The table below indicates the source and 
frequency of periodic data ingest operations that are performed; other operations may be needed 
on an ad hoc basis. 


Data Type 

Media 

Frequency 

ACS 

FTP 

Daily 
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Data Type 

Media 

Frequency 

Intel Plus 

FTP 

Weekly 

JICI 


One-time 

SAMNet 

FTP 

3X Daily 

Open Source 

CD 

Daily 

VGTOF 

CD 

Weekly 


Table 5-1 IDW Data Ingest Type, Media and Frequency 
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Automated Transfer of Raw Data to IDW-S 

Raw data is automatically transferred to the IDW-S system from approved data sources in 
accordance with an Interconnection Agreement, Memorandum of Understanding, Memorandum 
of Agreement or Interface Control Document. IDW-S VI. 2.9 receives update data by the 
following means: 

• ACS update data is transmitted to the IDW-S system via File Transfer Protocol (FTP) 
sessions over FBINet. ACS initiates the FTP session. 

• IntelPlus update data is transmitted to the IDW-S system via File Transfer Protocol (FTP) 
sessions over FBINet. IntelPlus initiates the FTP session. 

• SAMNet update data is transmitted to the IDW-S system via File Transfer Protocol (FTP) 
sessions over FBINet. For SAMNet, the IDW-S system initiates the FTP session. 

• VGTOF data is transmitted to the IDW-S system via CD/DVD. 

• Open Source News data is transmitted to the IDW-S system via CD/DVD. 

• The JICI library is static and is not updated on IDW-S. Outside the Scope 

• The HR library is static. 
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DATASET 

NAME DATA SOURCE CLASSIFICATION 


SAMNet 

FBI Secure 

Automated 

Messaging 

Network 

(SAMNet) 

Secret and below 


VGTOF 

FBI National 
Crime Information 
Center (NCIC) 

SBU 

JICl 

FBI Records 
Management 
Division (RMD), 
Document 
Laboratory 
(DocLab), FBIHQ 

Secret and below 

Open 

Source 

News 

MiTAP 

Unclassified 

1 Intelligence 
Information 
1 Reports 

CIA 

Secret 

Table 3.5.1.1 IDW 

-S Data Sets 
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SYSTEM N.AME 

CLASSIFICATION 

& 

COMPARTMENTS 

ACCREDITED 

BY 

TRANSFER 

METHOD 


FBI Secure 

Automated 

Messaging 

Network 

(SAMNet) 

Secret 

FBI 

FTP 


FBI National 
I Crime 
i Information 
Center (NCIC) 

Unclassified/SBU 

FBI 

CD-ROM 


FBI Document 

Conversion 

Laboratory 

(DocLab), 

Records 

Management 

Division (RMD), 

FBIHQ 

Secret 

FBI 

CD/DVD 


MiTAP - Open 
Source News 

Unclassified 

NA 

CD-ROM 


HR 

Secret 

CIA 

CD-ROM 



Outside the Scope 

149: 
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Jessage 


From:| |(OGC)(FBI) 

Se nt: Tuesday. September 28. 2004 9:58 AM 
To ! r OGC) (FBI) 

Cc: MILLER, WILLIAM A. (OGC) (FBI) 
Subject; IDW data sources 
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^sistant General Counsel 
Administrative Law Unit (Room 7338) 
Office of the General Counsel 


(202) 324[ 
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0\^RVIEW: WE ARE IN TRANSITION 
Moving From Reactive To Proactive 
Moving From Stovepipes To Enterprise 





We Are in a Dynamic New World: The Environment 
has Changed Radically and Things Will Be Different! 

Countering Terrorism Requires Us To Be Proactive. 
We Must Anticipate What May Happen And Prevent 
Terrorism Not Just Investigate It After The Fact. 

We Must Accelerate Our Ability To Find and React To 
Relevant Information. We Must Have Interoperability, 
Collaboration, Information Assurance, and Ready 
Access To All Relevant Data/ Information/ Knowledge. 

The Web, Metadata, COTS, Data Warehousing, Data 
Mining, Collaboration Technologies and Business 
Process Reengineering Will Fundamentally Transform 
the Way We Do Business. 





FBI Priorities 

1 Protect the United States from terrorist attack 

2 Protect the United States against foreign intelligence operations and 
espionage 

3 Protect the United States against cyber-based attacks 
and high-technology crimes 

4 Combat public corruption at all levels 

5 Protect civil rights 

6 Combat transnational and national criminal organizations and 
enterprises 

7 Combat major white-collar crime 

8 Combat significant violent crime 

9 Support federal, state, municipal and international partners 

10 Upgrade technology to successfully perform the FBI’s mission 



Reengineering FBI 
Information Technology 


Business Process Reengineering 



• Major focus on reviewing what we do and how we do it to see if we can do it 
better, eliminate it, or combine it. 

• Over 40 major BPR project ongoing 

• Major shift in resources to Counterterrorism 

• Restructuring of Information Technology in the FBI 

• New Deputy Executive Assistant Director for Information Technology 

• Major restructuring of IT & all IT acquisitions & realigning with FBI strategy 

• Professionalization IT acquisition, development & program management 

• Looking to Competitive Sourcing 

• Rapid prototyping to meet dynamic user needs 




Problems with Existing 
Data Infrastructure 




Interfaces Cumbersome 

- Unique Application Access, Most Lack an Efficient Web 
Interface 

Access to Data Bases Restricted, Limited, Stove- 
piped. No Big Picture of All the Available Data 

- We Do Not Really Know What We Know or Who Has It 

Lack of Critical Data in the Data Bases 
Tremendous Duplication & Redundancy. 

No Ability to Digitally Sign and Secure the Data 



No Access To 
External Sources 




BEST COPY AVAILABLE' 


Where We Are Headed: 

An Information Enterprise 

• Layered Architecture 

• Separate layers to allow modular changes to 
architectural as well as system components 



Presentation 
Web Browser 


Business Applications 
Virtual Case File 



Data Layer 
Data WarehouseA^KB 

Infrastructure 
Jrilogy Network, 
Server & WS 



The Vision 

Virtual Case File 

Provides The Business logic and 
Processes To Enter, Change and 
Process Data relative to a case - It 
is How We Should Do Our Job in 
the Future. Does Piot Apply to 
Non-Investigative applications. 

Records Management 
Application; 

Provides central control of all 
FBI records in accordance 
with Federal Statutes & Policy. 
Part of the controlling function 
for the Data Warehouse. 

Master Data Warehouse: 

Stores All FBI Enterprise Data & 
Externa] data to Minimize Cost 
and provide Enterprise Access to 
All our Data by all applications. 
Combines Data into a searchable 
information sphere that can be use 
for data mining or cross indexing 
without going through the legacy 
Applications. 

- Key to interoperability. 










"BEST COPY AVAILABLE" 


Finding Drops of Information In An 
Ocean of Data & Connecting the Dots 


FBI Phoenix j I Moussaoui 
Memo Arrest 


Data Is In Different Formats, Different Media, Different Classifications, at Different Locations 


Suspect 

Traffic 

Violation 


Aiiibs in rT “■ 

Flight Trng ] | Aug 13,01 


Suspects Financial VISA 
Living at Transactions Eiplration INS 

Same Address . 
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F uture Environment Must Support 
All Types of Data 


Automated 
Case Files 


Wiretaps & 
Surveillance 


Legacy 
Data Bases 

Local Law Enforcement, 
Arrest Reports, DMV, 
Vehicle Registrations, 
Etc... 

Open Sources 
& Web Products 



investigative Reports 
& Evidence . . . 


Forensics: Blood, 
Fingerprints, DNA, etc 

Immigration 
Records 

DEA & ATF Data 

Intelligence Data 

Terrorist Watch Lists 


Data from Search Warrants: Bank 
Records, Credit Card Transactions, 

Hotel, Airlines, Printed Documents etc. 

Data includes: Documents, electronic files, images, audio, 
Graphics, Muitimedia, databases, Web products, etc... 

Law Enforcement is an Information Intensive Business 


Why Build A Data Warehouse? 

A Data Warehouse Allows Us To Store Enterprise Data that We 
Own and Control to Minimize Cost and Maximize Benefits. 


• Gives You Total Knowledge of Everything You Have! 

• Today we do NOT Really Know What we Have or Where It’s At 

• Makes Data available to all Applications from one Source 

• Eliminates Stovepipe View of one System at a Time 

• Simplifies Migration of Old Obsolete Data Stores & Applications. 

• Reduced Cost of Operations & Maintenance 

• Separates Data Access from Applications: 

• Greatly Improves User Access 

• Becomes an Enterprise Service 

• Simplifies & Speeds Up Application Development 

• Provides Information Exchange Portals Or Data Marts 

• Simplifies Accessing & Locating Information 

• Supports Information Sharing 

• Support Transferring & Combining Data 

• Improves Security Access & Control 




Enterprise View of All Your Data 

Users Don’t Care Where the Data Is or How it is Stored They Just Want Easy Access 

O ' O • /• 6M, Viriii:^^tnrm:'.Took »*» * |S3j 


Name: Al-Ji<l<li. A1 Rajrfj^iiiAJjH|t]!|ippm 
Natioaalitv; Tmddah" : 


Race: Aiah Complexion: Olive 

Height: 5* •>" Weiglit: 170 lb 

Identifiers: Foni inch Scai' on left forearm 


Hail-: Black 
Eyes: Brown 


St. Address: 43”B Maple St City: Montreal 
State: Quebec Zip: Counhy: Canada 

Profession; Chil Engineer Eiui)loyeixTFS Shipping 
Education; Cano University Spouse: JTJhlaiown History:*^ 

H.Plioiie:,p7js);^l® 

Sager:^:(^S)A2®^2^p<j^ 

'.j .-j < 

Vehicles: . 1958 
Aliases: ' 

Moliiunefl A1 Habid 
Rimfiel Bin Seffi 
Ab del laouf J<tey 

AflUiation.'!: .AJ Qaida 





SH| 

iBB 


1 

rnUm 



Iininigratioii S'tatm: Exi>iied 
Citizenship: Caiindinu 
Date AiTivTilPart Fipm Carrier | 
0$-07-09 NewVork kionlnal M 


Fieviou Hittoijr P> 


C'rimiluil Bockgi ouiul: Su.s']>ecte<l TeiTO|ist.v <& Assn&'siii 
De,scrij)tiou: Al-Jidcli i.s' believed to have joiu^^d tlie Al Qaida terrorist oigajuizatiou in 
1991. He trained in Atehaaistmi and was beiievecl to have helnecl nlan tlie IIHR role ' 
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'BEST COPY AVAILABLE' 


Information Framework 



Presentatiori 

Layer 


Access 


integrated DATA 

Using Storage Area Network (SANl W^-i^pATA BASES : PAT^AS^ 


Layer 


Virtual 

Layer 


Physical 

Storage 

Layer 

Transport 

Layer 






Total View — of All Relevant Info via 
Virtual Knowledge 





•Virtual Knowledge Base 
A combination of distributed 
data bases and data warehouses 
(including external sources you 
do not own) into a searchable 
information sphere that can be 
use for data mining or cross 
indexing. 


















FBI Interim Architecture 






J 



Information Sharing & Collaboration Using the 
Intelligence Community Model 

Unclassified DaU ISiC^IC^ 
Warehouse 



FBI NET 


Do NOT Share 
With Anyone 
Else 


FBI Data 
Marts 

Limited 
Sharing Under 
Special Rules 


^fauiiaieiui 

Applications 

Share with All 
Cleared who have a 
valid need-to-know 




Data Mining & Exploitation 

FiEding unrecognized relationships or correlations between entities 
Goes beyond simple cross indexing or table look ups. 


Data Warehouse & 


Virtual Knowledge Base 


Significant 
ata 


Process: 



Collect: I Field 

Government Agents 

Public a Private Data 


investigative 


Findings 







Data Mining: R equires new Functions, "New Data, 
New Tools, New Procedures and Additional Personnel 






FBI Strategy: 






• Provide a Complete, User-friendly, Tailorable Integrated Environment 
for all users with web-based, commercial-off-the-shelf (COTS) 
applications and specialized Government applications, with a single user 
sign-on that for each security level that support all functions. 

• Provide easy access to all authorized data and information without 
knowing its format, location, or classification (Maintains Need to Know) 
through a Data Warehouse and Virtual Knowledge Base. 

• Provide Rapid delivery and insertion of new COTS technology based on 
customer feedback, new requirements, commercial developments and 
annual reevaluations. Test before you buy! 

• Provide Automatic Publishing & Dissemination using meta-data and 
subscription services 

• Support Active Collaboration and Data Sharing across Law 
enforcement, intelligence and with other Agencies. 

• User Driven End-state. Only the users can determine if a tool works for 
them. Need set of interoperable tools. Must have Active User 
Involvement Driving the Process. 

Capability = Tools + Infrastructure + Training + 

Trained Users + CONORS + Management Commitment 

• How Do We Make This Happen? 
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Data Sources in IDW and SPT 

Below is a summary of the 12 data sets that are currently in the main IDW as well as the 
10 in the TFOS/REJET special access page. The additional 14 other data sets that will 
shortly be ingested by TFOS/RRET are also detailed below as well as 5 other proposed 
CTD TFOS/RRET data sets. 


IDW 

The following data sets and their approximate sizes, as of 06/03/2004, are 
currently available through the main IDW: 

Automated Case System (ACS) Electronic Cas£_EikJECF) 

This data set contains copies of approximatelv l E Cs. FD-302s, Facsimiles, 

FD-542S, Inserts, Transcriptions, Teletypes, Letter Head Memorandums (LHM), 
Memorandums and other FBI documents co ntained within ACS/ECF for all hut the 
following FBI case classification violations: I I 


1 1 he files are updated daily; 

Violent Gang and Terrorist Organization File (VGTOF) 

Lists of individuals and organizations associated with violent gangs and terrorism, 
provided by the FBI National Crime Information Center (NCIC). This file is updated 
periodically, usually monthly; 


Secure Automated Messaging Network (SAMNet) 


SAMNet consists of messaging traffic that is sent between different U.S. Government 
agencies through the Automated Digital Information Network (AutoDIN), including 
Intelligence Information Reports (IIRs) and Technical Disseminations (TD) fi-om the 
FBI. Central Intelligence Agency ( CIA). Defense Intelligence Agency (DIA). and others 


are updated daily; 


J these files"" 


b2 


1 


h2 

hlE 
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I I 

IDW System 


Data sources currently in IDW 


Full Name 

Abbrev. 

Owner 

Reqmt/Ref. 

Class. 

Data Filtering Restrictions 

Dissemination Restrictions 

Automated Case 
System/Electronic Case File 

ACS/ECF 

FBI 

— 


Secret 

Only case dassitications required to 
support intelligence analysis are 
allowed in IDW; Grand Jury 
information is also excluded. List of 
case classifications is available in EC 
242-HQ-1139716 (serial 252) 

FBI only 

Violent Gang and Terrorist 
Organization File 

VGTOF 

FBI 


Sensitive But 
Unclassified 


Only supposed to be used for criminal justice 
purposes. 

Secure Automated Messaging 
Network-Secret 

SAMNet-S 

FBI 


Secret 


Exclusively for the use of criminal justice 
entities. 

IntelPlus (SIX filerooms listed 
below) 


FBI 


Secret 

Only supposed to be used for 
criminal justice purposes, and should 
not be disseminated outside of the 
Bureau. 

FBI only 
















TFOS Fileroom 





















Domestic Terror 







Joint Intelligence Committee 
Inquiry 

JICI 

FBI 



Secret 

Only supposed to be used for 
criminal justice purposes, and should 
not be disseminated outside of the 
Bureau. 

FBI only 







, . 


OTHER 0/S 


1 of4 



IDW System 


Data sources currently in IDW 


Full Name 1 Abbrev. > Owner | ReqmtfRef. | Class. | Data Filtering Restrictions 1 Dissemination Restrictions 






Secret 

Certain data is restricted by the case 
agent in the field; think this 
infomiation should be available to 
analysts, but need a policy to support 
this assertion. 

FBI only 

Telephone Application! 

1 

taQ 

FBI 












b2 

b7E 


EC 66F-HQ- 
C1434337 

Sensitive But 
Unclassified 

Unknown - more analysis needed. 

Unknown - more analysis needed. 

CIA lIRs and TDs 


CIA 

EC 66F-HQ- 
C1434337 

Secret 

Unknown - more analysis needed. 

Unknown > more analysis needed. 






Passport Fraud data 

■ 

Dept of State 


Unknown 

Unknown - more analysis needed. 

Unknown - more analysis needed. 

Lost/Stolen Passport data 


Oept of State 

EC 66F-HQ- 
C1434337 

Unknown 

Unknown - more analysis needed. 

Unknown - more ar^lysis needed. 

nIelPlus fadditional filerooms) 









FBI 

EC 66F-HQ- 
C1434337 

Unknown 

Unknown - more analysis needed. 

Unknown - more analysis needed. 


FBI 

EC 66F4HQ- 
C1434337 

Unknown 

Unknown - more analysis needed. 



FBI 

EC 66F-HQ- 
C1434337 

Unknown 

Unknown > more analysis needed. 



FBI 

EC 66F-HQ- 
C1434337 

Unknown 

Unknown - more analysis needed. 

Unknown > more analysis needed. 


2 of 4 






















b2 

b7E 


1 1 ~T~ ^ ^ ^ ^ 


DW System 

1 1 ^ ^ ^ ^ 

Data sources currently in IDW 

Full Name 

Abbrev. 

Owner 

Reqmt/Ref. 

Class. 1 Data Filtering Restrictions 

Dissemination Restrictions 

Immigration and Naturalization 
SetviceJ I 


INS 


Unknown junknown - more analysis needed. 

Unknovm - more analysis needed. 


4 of 4 
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Se nt; Tuesday. Septembe r 28, 2004 9:58 AM 
To; | I fOGC) (FBI) 

Cc; MILLER, WILLIAM A. (OGC) (FBI) 
Subject: IDW data sources 
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9/28/2004 



Message 


Page 4 of 6 


Assistant General Counsel 
Administrative Law Unit (Room 7338) 
Office of t he Gen eral Counsel 
(202) 324 1 I 


Original Message 

From; MILLER, WILUAM A, (OGC) (FBI) 

Se nt; Monday, Sep tember 27, 2004 6:36 PM 

Tn| lrnnrr^r:A) 

Cc^ |(OGC) (FBI) | | (OGC) (FB!);!" 

KELLEY, PATRICK W. (OGC) (FBI) 

Subject: RE: Information Sharing Policy Group Mtg - 9/28, 2:00, Rm 7846 


l(OGC)(FBI); 


NON-RECORO 


OTHER 0/S 


9/28/2004 
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O riginal Message 

From i I fOn (OGA) 

Sent: Friday, September 24, 2004 12:39 PM 

To: SZADY, DAVID (CD) (FBI); ASHLEY, GRANT D. (DO) (FBI); AZMI, ZALMAI (COO) (FBI); BAGINSKI, 
MAUREEN A. (DO) (FBI); BAILEY, GREGG D. (ITOD)(FBI); BALD, GARY M. (CTD) (FBI); BROCK, KEVIN R. 
(OI)(FBI); Caproni, Valerie E. (OGC) (FBI); FUENTES, THOMAS V. (010) (FBI); HOOKS, JOHN S. (OIS) 
(FBI); HOOTON, WILLIAM L (RMD) (FBI); MONROE, JANA D. (CyD) (FBI); PHALEN, CHARLES S JR (SecD) 
(FBI); PISTOLE, JOHN S. (DO) (FBI); QUUAS, LOUIS F. (DO) (FBI); SOLOMON, JONATHAN I. (DO) (FBI); 
SWECKER, CHRIS (QD) (FBI) 

Cc: TANNER^^RHA..(D0)(FBI) | If lTOD) (FBI); GRIGG, G CLAYTON (CTD) (FBI); 

|JlTOD)(F^ J(OI) ( TON); ALLEN. MARIE B . (RMD) (FBI); 

im (FBI) ] IfODVFBni I fOIO) (FBI); 

, lOipD) (FBI); | r CD ) fFBI); CASEY. ROBER T E. JR (01) 

(FBI)] |(SA)(FB I); CHASE, WILLIAM D ( AL) (FBI) I IfS ecDI (FBI); 

FEDARCYK, MICHAEL R. (CTD) (FBI) f > ME) (FBI) j I fOIQ) (FBI); 

fSJ) (FBI); HALL, DEAN E. (SecD) (FBI); HENDER SHOT, HAROLD M. fRMD VFBn: 


JCQD) (FBI)I 
N. (CTD) (FBI) 


_l(DO) (FBI); KELLEY, PATTUCK W. (OGC) fFBU 
□(QD) (FBI); LEWIS, JOSEPH R, (QD) fFB D] 

}IS) (FBI); MILLER, WILLIAM A. (OGC) (FBI)LII 

rSecDl fOGAM IfOGC) (FB!)] 

boUFBDf 

roi u^) ! 

[ DO) (FBI) 


JDO) (FBI); 

-—-IZZiaiS) (FBI); 
rC TDUFBn: 
KCdVcFBH: 

J(CyD)(FBI) ] 

(DO) (FBI); VAN DUYN, DONALD 


Subject: Information Sharing Policy Group Mtg - 9/28, 2:00, Rm 7846 


The Information Sharing Policy Group meets on Tuesday, Sept 28, at 2:00-3:00 in Rm 7846. Attached 
are: 


9/28/2004 
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UNCLASSIFIED 
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SENSITIVE BUT UNCLASSIFIED 
NON.RECORD 


OTHER 0/S 


be 

b7C 


— Original Message — 

From: TANNER, MARK A. 

Sent: Monday, August 09, 2004 4:12 PM 

To i i DOyFBn: BAIl-EY, GREGG D. (ITOD)(FBI);| 

□(OIS) (FBI) 

Cc: PISTOLE, JOHN S. (DPI (FBI): FEDARCYK, MICHAEL R. ( CTD) (FBI); HARRINGTON, T 
J. (CTD) (FBI) i 1 

Subject: RE: ACCESS TO VISIT 


b2 

b7E 


OTHER 0/S 



Mark A. Tanner 
Director of the 
Foreign Terrorist Tracking 
703-4181 I 


Task Force (FTTTF) 


be 

b7C 


1dO)(FBI) 


O riginal Message 

From I 

Sent: Monday, August 09, 2004 3:2 2 PM 
To: BAILEY, GREGG D. (IT0D)(FBI) | 

MARK A. 

Cc: PISTOLE, JOHN S. (DO) (FBI); FEDARCYK, MICHAEL R. (CTD) (FBI) 
Subject: ACCESS TO VISIT 


(aiS) (FBI); TANNER, 


SENSITIVE BUT UNCLASSIFIED 

NON-RECORD 


file ://C :\Documents%2Qand%20Setting j I Local%20Settings\T emporary %20Inter. . . 


be 

b7C 


11/6/2006 





Message 
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b6 

hlC 


Cc: 


}oGCKFBr) 


From: | | OGC)(FBI) 

Sent: Tuesday, August 03. 2004 2:41 PM 

To: J Iron rnfi 


% 


(IRD) (FBI): GRIGG, G CLAYTON (CTD) (FBI): 
D) (FBI); Capronf, Vatene E. (OGC) (FBI); BAGINSKI, MAUREEN A. 


(DO) (FBI) 

KELLEY. P ATRICK W. (QGC\ fFBO: MILLER. Wl l I lAM A ^FRnf 

(OGC) (FBIl l r OGC) (FBI)l 


John F. (OGC) (OGA) 
Subject: FinCEN data for IDW 

SENSITIVE BUT UNCLASSIFIED 
NON-RECORD 


ICGC) (FBI): Curran, 
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Mr. | I 


bS 


Assistant General Counsel 
Administrative Law Unit (Room 7338) 
Office of t he Gene ral Counsel 
(202) 324 j I 


SENSITIVE BUT UNCLASSIFIED 


b6 

b7C 


8/3/2004 
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OTHER 


From j ~lr OGC^ (FBI) 

Sent: Friday, July 16, 2004 8:26 AM 

To; Curran, J ohn F. (OGO ('OGA'if 
(OGC) (FBI);| 

(OGC) (FBI) 

Cc: KELLEY, PATRICK W. (OGC) (FBl£ 
Subject: FW: IDW Presentation 


ioncHFBiyr 


lOGC) (F BI);f 


|[OGC); MILLER, WILLIAM A. 


(OGC) (FBI) 


UNCLASSIFIED 

NON-RECORD 


b5 

b2 

b7E 


Or iginal Messaqe- 

From:f^ 


Sent; Friday. July 16. 

Toi 
Cc 


(FBI) 

Subject: RE: IDW Presentation 


]JPMO) (FBI) 

3 8:11 AM 
OGC) (FBI) 

:) (FBI); RTTCHHART, KENNETH MICHAEL (IRD) (FBI) 


(IRD) 


be 

b7C 


UNCLASSIFIED 

NON-RECORD OTHER 0 /S 


— O riginal Message 

From ] ~l (OGC) (FBI) 

Se nt; Thursday, July 15, 2004 4:32 PM 
To j [ PMO) (FBI) 

Subject: RE; IDW Presentation 

UNCLASSIFIED 

NON-RECORD 


O riginal Message-— 

From j r PMO) (FBI) 

Se nt; Thursday, July 15. 20 04 4:10 PM 
To i I fOGO (FBI) 

Subject: IDW Presentation 

UNCLASSIFIED 

NON-RECO RD 


be 

b7C 


fi lo- //(”' A Oci nHO/i' 7 nSf*t+ina<£ 


5 ■nr‘.nl®/n9nSpttina<5\Tpmnnrarv%2nTnter 1 1/6/9.006 
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OTHER 0/S 


— Or iginal Message — 

From J t OCA) (FBI) 

Se nt: Friday, February 18 . 2005 2:45 PM 

To l I rOGG (FBI); MIUER, WILLIAM A. (OGC) (FBI) 

Subject: Review of Proposed Response re; Data Mining 

UNCLASSIFIED 

NON-RECORD 


be 

bvc 


OTHER 0/S 
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1 1 if.nr\(\f. 
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OGC colleages: 









b6 

'hlC 


202-324[ 


he 

hlC 

b5 


Sent: 

To: 


— Ori ginal Message-- 

From: [_ 


loi) (OGA) 


Wednesday, ^ntemhtr n . 2006 11:2 4 AM 
-L 




IfOGC^ fFBtC 


Ca GRIGG, G. OAKTON (CTD) (FBI 
Subject: RE: Tentafve meeOng next weel 


roGc ^Trenf 

J(OGC) (FBI)l 


l oGOfFBIVr 


VAN DUYN. DONALD N. 


CTD) (FBI) 


■ t oGC) (FBDI 
tOGQ (FBI) 


"Togo (fbii: 


JoGQ (FBI); 


loGC) 


SEQRET 

record 319X-HQ-XXXX 


OGC colleages: 


b5 

be 

b7C 




It works for me and I would like to attend. 


Assistant General Counsel 
7 c PfivaQ/ a nd Civi l Liberties Unit, Loom 7338 
202-324\ Vvoice) 

202-324^ facsimile) 

PRIVILEGED DELIBERATIVE DOCUMENT - NOT FOR DISCLOSURE OUTSIDE THE FBI WITHOUT 
PRIOR OGC APPROVAL 


](OGC)(FBI) 


be 

b7C 


— Original Mess age — 

From: I 


2 






OGC colleages; 




b6 

b7C 

b5 


It works for me and I would like to attend. 


Assistant General Counsel 

Privag and Civil Liberties Unit, Room 7338 


202-3 24\ ^facsimile) 


PRIVILEGED DELIBERATIVE DOCUMENT - NOT FOR DISCLOSURE OUTSIDE THE FBI 
WITHOUT PRIOR OGC APPROVAL 



To the extent possible - does that work for everyone who wants to attend? 


3 





be 

b7C 

b5 


— Original Message— 

From: I 


Sent: 

To: 


Cc: 
Subject: 


SE^ 
RgCORD 


](OGC) (FBI) 

VjL^nesday, geptember If 2006 10:54 AM 

OGQ(FBI)i IfOGO fFBnT 


/OGG (FB^ I 


OGC) (FBI)£ 


JPGQ fFRIli 


(OGQ (FBn 
I t on (OGA) 

RE: Tentative meeting next weel^ 


JOGC) (FBI)r 


Tfocn rFRni 






319X-HQ-XXXX 


be 

b7C 


I [ can you try to have this on Thurs next week? 


[ 


Assistant General Cou nsel 
Policy & Training Unit 
National Security Law Branch 
(202) 324^ 


be 

b7C 

b5 


WIiyiMdl 

From: 

Sent; 

To; 


[ 


3[0GQ(FBI) 


Wednesday. Septem ber 13, 20 06 10:51 AM 
](OGC) ( FBni 


Cc; 

Subject: 

SE^R^ 

319X-HQ-XXXX 


Tfo^ureivf , 

(OGC) mn _ l (OGCT(FBi^ 

JOGC) (FBI) 


^6gc) (FBn 


IFBuT 


b n (05^ , 

Tentative meeting next weelq 


](OGC) (FBI); 


be 

b7C 

b5 


DERIVED FROM: Multiple Sources 


4 



](OGC) (FBI) 


From: 

Sent: 

To: 

Cc: 

Subject: 


UNCLASSIFIED 

NON-RECORD 


MILLER, WILLIAM A. (OGC) (FBI) 
Wednesday, October 04, 2006 4:4 1 PM 
GRIGG. G. CLAYTON (C TD1 (FBI)[ 


lOGC) (FBI)t; 

Pa trick w. (Ogci (fbh 


RE 


~~lfOGg (FBI) 
JOGC) (FBI); KELLEY, 


ALL IIJFORHATION COHTAIHED 
HEREIH IS UHCLASSIFIED 


•b6 

b7C 

b5 


DATE 03-27-2007 BY 65179 DHH/BJA/CAL 


b5 


Original Message — 


From: 

Sent: 

To: 

Cc: 

Subject: 


GRIGG, G. OAYTON (CTD) (FBI) 
Wednesday. Ort-nher 04 ?pnfi 2:18 PM 
JOGC) ( FBI) 


(O GC) (FBI) 

'^1__ 


3oGC) (FBI){; 


JOGC) 


] 


(FBI); MILLER, WILLIAM A. (OGC) (FBI); KELLEY, PATRICK W. 


b6 

b7C 

b5 


UNCLASSIFIED 

NON-RECORD 


Good points. We do receive updates for some of the data sets which give us instructions as to which to add, modify or 
delete. As far as accuracy some are corrected in this way while others are not. For example, if a foreign national provides 
inaccurate or untrue information on the 1-94 card they fill out as their plane is landing in the US, neither DHS or us can 
control that. The information is put on the card by them, retyped into a database verbatim by DHS and shared with us. 
That is an example of a potential inaccurate or untrue record that would not be corrected. 

In contrast however, another record that we get that could be corrected is an ACS or UNI record. One week we may get a 
dump from ACS. The next week they may send a correction notice to remove duplicate documents, correct a case ID, etc. 
These would be handled accordingly. The same happens with data from FinCEN and others. If for example some intel 
agency writes a cable on SAMNET and we ingest it today, then later they debunk the source, they will issue a new cabie 
taking back the clairri on the old cable. But the original cable remains as a matter of record and the new one stands as a 
correction to the original. The problem is both simple and complex to describe and address. 

Our intention and goal is to model as best as possible the records contained in the primary system. Therefore, if the 
prirnary system allows for updates or changes to the record then we will reflect the change. In this way we most resemble 
a mirror and the central burden remains on the primary system. 

G. Clayton Grigg 
Acting Director 


Foreign Terrorist Tracking Task Force (FTTTF) 
Counterterrorism Division (CTD) 




be 



b7C 

(703) 553- 


Office) 

b2 

(202) 262- 


Cell/Blackberry) 

(877) 270- 


Panpr) 




— Original Message — 


1 






be 

b7C 

b5 


From: I j- OGG (FBI) 

Sent; Wednesday, October 04, 2006 1:04 PM 

To: GRIGG. G. CUYTON (CT DI (FBO 

Cc I IfOGC) (FBI)i {OGQ (FBI); MILLER, WILLIAM A. fOGO IFBH: KELLEY. PATRICK W. 

fOGCUFBII 

Subject: RE j | 

UNCLASSIFIED 

NON-RECORD 


b6 

b7C 

b5 


b2 

be 

b7C 


Assistant General Counsel 

Privacy and Civi l Uberties Unit, Room 7338 


202-324 

202-324 


(voice) 

(facsimile) 


PRIVILEGED DELIBERATIVE DOCUMENT - NOT FOR DISCLOSURE OUTSIDE THE FBI WITHOUT PRIOR 
OGC APPROVAL 


be 

b7C 

b5 


Original Message 

From: GRIGG, G. CLAYTON (CTD) (FBI) 

Sent: Wednesday, October 04, 2006 11 :15 AM 

To: KELLEY, PATRICK W. (OGC) IFBIll 

(OGC ) (FBI)I 


Cc 

Subject{ 


(FBI) 

HARRINGTON. 


J. CCTDIp D^ 


tCTP) (FBI)r 


t OGO (FBI); MILLER. WILUAM A. (OGQ (FBI)| 
ToGC) (FBI)j l OGC) (FBI)f“ 

t r rsD)(FBi) — 

| (CTD)(FBI) i I NSB) (FBI) 


UNCLASSIFIED 

NON-RECORD 



b5 


T 







kOGC) (FBI) 


From: 

Sent; 

GRIGG, G. CLAYTON (CTD) (FBI) 
Wednesday, October 04, 2006 8:34 PM 



To: I 

l(DO) (FBI) 



Cc: I 

tlTSD)(FBI); 

IfOGC) (FBI) 

kOI) 

Subject: 

TU5A) 

RE: Query regarding IDW 




ALL IHFORHATIOir CONTAIIIED 
HEREIH IS UNCLASSIFIED 

UNCLASSIFIED DATE 08-27-2007 BY 65179 DHH/BJA/CAL 

NON-RECORD 


For more additional information you can also contact 


m 


he 

The basic process works like this; 


1 . An operational division, unit or group identifies a need for a particular data source 

2. Requirements are gathered regarding the data source (i.e. Data source description, operational need, data type, 
location, size, classification, etc.) 

3. The data source is nominated for future consideration by the Information Sharing Policy Board (ISPB) 

4. Before the ISPB rules on the data source it is reviewed by the OGC, Security, etc. and a Privacy Impact Assessment is 
completed 

5. Any issues identified by this review are addressed and if they are correctable and then the data source is proposed to 
the ISPB for approval 

6. The ISPB then reviews the findings by OGC, Security, etc. and either approves or disapproves the new source 

7. Once approval is obtained the data will be ingested. 


I would like to review what you draft before your reply if possible. 


NOTE: It should be noted that even before a data source arrives at the ISPB for review by OGC, Security, etc. an 
extensive requirements gathering process is conducted. This involves meeting with the original data source owner (if from 
another agency then this involves inter-agency meetings, sometimes Memorandum of Understandings as occurred with 
FinCEN). Additionally, the idea is often run by OGC even before presented to ensure the proper requirements are 
gathered. Another concern and item to keep in mind is the resources and technical capacity to absorb a data source. / ~ h2 

hlE 

There are a number of decisional tradeoffs that factor into what data source is acquired in what order. 


G. Clayton Grigg 
Acting Director 

Foreign Terrorist Tracking Task Force (FTTTF) 
Counterterrorism Division (CTD) 

r 

' b6 

hlC 


(703) 553 
(202) 262 
(877) 270 


(Office) 

(Cell/Blackberry) 
IPager) 


JBIackberry UNCLASS) 


b6 

b7C 


Original Message 

From; I If DO) (FBI) 

Sent; Wednesday, October 04, 2006 5:18 PM 

To; GRIGG, G. OAYTON (CTD) (FBI) 

Subject: RE: Query regarding IDW 

UNCLASSIFIED 

NON-RECORD 


Mr. Grigg, 


1 




b2 

b6 

b7C 

b7E 


lam aware of the letter and have read it By way of background, I do not have any correspondence or 
documents from other agencies that have refused to contribute information to the system or demonstrate 
unwillingness. To the contrary we have received great simnnrt nr that i ha up mnrriin^toH 
gone after, we have received cooperation I | 


jAaditionaiiy, ror every new data source approvals, suitability reviews, Privacy Impact 
Assessments, etc. rnust be obtained and concurred with frorn entities likeOGC the Information Sharing 
Policy Board, Security, prior to ingestion of any new data. Uq 3 f TFOS could orobablv 

add to this. ' ’ 


be 

b7C 


The situation with the IDW is that all available data that we had resources for, deemed most operationally 
critical and/or had ready access to has been pursued or proposed. The program has not be limited by 
unwillingness to share. In my estimation the cooperation has been unprecedented and is one of the 
program s most profound successes. The amount of data in the system has experienced a 27x growth 
factor in the last 2 1/2 years and 34x in the number of accounts. Utilization across all program lines is 
growing and 1000s of accounts have been created for non-FBI users. The system went from 12 
collectrans to 53 data sets Because of itfi siirne ss demand has significantly outpaced resources and 

capacity. This has caused jof the IDW in concert with CTD to mana ge these chan 

and mitiqa te where possible the risks Imposed by this resource constrained environment! 

pf IDW is compiling the list of databases in IDW. 


les 


b2 

be 

b7C 


G. Clayton Grigg 
Acting Director 

Foreign Terrorist Tracking Task Force (FTTTF) 
Counterterrorism Divisinn (CTD) 


(703) 553 
(202) 262: 
(877) 270: 


(Office) 

(Cell/Blackberry) 

(Pager) 

^Blackberry UNCLASS) 


ALL INFORHATIOII COMTAIHED 

HEREIN IS UNCLASSIFIED 

DATE 08-27-2007 BY 65179 DHH/BJA/CAL 


— Original Mess age — 

■ Z]dO) (FBI) 

Monday, September 11, 2006 1:16 PM 
GRIGG, G, CLAYTON (CTD) (FBI) 
Query regarding IDW 

UNCLASSIFIED 

NON-RECORD 


b7C 


From: 

Sent: 

To: 

Subject: 


be 

b7C 


Mr. Grigg, 


Im an a^nt in Congressional Affairs, with responsibility for the Senate Committee on the Judiciary 
Senator Charles Grassley(R-IA) is a member of the committee. The attached letter from Senator 
Grass ey requests information regarding sources for the records contained in IDW. Specificially 
Grassley wants to know what agencies are not participating in IDW. 

Please take a look at the letter, and give me a call to educate me on the process. 

ThanKs, 


« File; grassley incoming re IDW.pdf » 


3 






)37C Supervisory Special Agent 

Office of C ongressi onal Affairs 
(202) 324 j I 

UNCLASSIFIED 

UNCLASSIFIED 

UNCLASSIFIED 

UNCLASSIFIED 

UNCLASSIFIED 


UNCLASSIFIED 



OGC) (FBI) 


From: 

Sent: 

To: 

Subject: 


Thursday. September 2 


3oGC) (FBI) 


PATRICK W. (OGC) (FBI) 
FW; Query regarding IDW 


2006 4:10 
J[OGC) (FBI) 




](OGC) (FBI); KELLEY. 


be 

b7C 


UNCLASSIFIED 

NON-RECORD 


be 

b7C 


fyi 

Original Message 

From: GRIGG, G. CLAVTON (CTD) (FBI) 

Sent: Thursday, September 21 , 2006 9 :10 AM 

To: MILLER, WILLIAM A. (OGC) (FBlj 

Subject: FW: Query regarding IDW ' 


lOGQ (FBI) 


UNCLASSIFIED 

NON-RECORD 


FYI below re: IDW from Senator Grassley. 


G. Clayton Grigg 
Acting Director 


Foreign Terrorist Tracking Task Force (FTTTF) 
Counterterrorism Divi.«;if| n (CTD) 


(703) 553 
(202) 262 
(877) 270. 


b2 

be 

b7C 


(Office) 

(Cell/Blackberry) 

(Eager) 

[Blackberry UNCLASS) 


— Original Mess age 

be From; 1 b o) (FBI) 

b7C Sent: Monday, September 11, 2006 1:16 PM 

To: GRIGG, G. CLAYTON (CTD) (FBI) 

Subject: Query regarding IDW 

UNCLASSIFIED 

NON-RECORD 


Mr. Grigg, 

rm an agent m Congressbnal Affairs, with responsibility for the Senate Committee on the Judiciary. Senator Charles 
Grassley(R- A) is a member of the committee. The attached letter from Senator Grassley requests information regarding 
records contained in IDW. Specificially, Grassley wants to know what agencies are not participating in 


Please take a look at the letter, and give me a call to educate me on the process. 
Jhanka , 


1 





UNCLASSIFIED 

NON-RECORD 


Good points. We do receive updates for some of the data sets which give us instructions as to which to add, modify or 
delete. As far as accuracy some are corrected in this way while others are not. For example, if a foreign national provides 
inaccurate or untrue information on the 1-94 card they fill out as their plane is landing in the US, neither DHS or us can 
control that. The information is put on the card by them, retyped into a database verbatim by DHS and shared with us. 
That is an example of a potential inaccurate or untrue record that would not be corrected. 


In contrast however, another record that we get that could be corrected is an ACS or UNI record. One week we may get a 
dump from ACS. The next week they may send a correction notice to remove duplicate documents, correct a case ID, etc. 
These would be handled accordingly. The same happens with data from FinCEN and others. If for example some Intel 
agency writes a cable on SAMNET and we ingest it today, then later they debunk the source, they will issue a new cable 
taking back the claim on the old cable. But the original cable remains as a matter of record and the new one stands as a 
correction to the original. The problem is both simple and complex to describe and address. 


h2 

b6 

hlC 


Our intention and goal is to model as best as possible the records contained in the primary system. Therefore, if the 
primary system allows for updates or changes to the record then we will reflect the change. In this way we most resemble 
a mirror and the central burden remains on the primary system. 


G. Clayton Grigg 
Acting Director 


Foreign Terrorist Tracking Task Force (FTTTF) 
Counterterrorism nivision (CTD) 


ALL IHFOPMATIOH COMTAIJIED 

HEREIN IS UNCLASSIFIED 

DATE 08-27-2007 BY 65179 DHH/BJA/CAL 


(703) 553 (Office) 

(202) 262 (Cell/Blackberry) 

(877) 270( l(Pa qer) 

I fBlackberrv UNCLASS) 


b5 

b6 

b7C 


Original Message- 

From: I 


Subject: 


KOGC) (FBI) 

Wednesday, October 04, 2006 1:04 PM 

GRIGG. G. CLAYTON fODI fFBO ^ 

r OGC^ (FBI)J 


JOGQ (FBI); MILLER, WILUAM A. (OGC) (FBI); KELLEY, PATRICK W. 


UNCLASSIFIED 

NON-RECORD 



1 






bS 
b6 
' '’C 


b2 

be 

b7C 


Assistant General Counsel 
Priva^ and Civil Liberties Unit, Raom 7338 
202-324 
202-324 


'voice) 

'facsimile) 


PRIVILEGED DELIBERATIVE DOCUMENT - NOT FOR DISCLOSURE OUTSIDE THE FBI WITHOUT PRIOR 
OGC APPROVAL 


be 

b7C 

b5 


Original Message 

From: GRIGG, G. CUYTON (CTD) (FBI) 


Sent: 

To: 


Cc: 

Subjectj 


Wedn^ay, October 04, 2006 11 ^5 AM 
(FBI)t 


KELLEY, PATRICK W. (QGD tFBTI 
(OGC ) (fbdF 


HARRINGTON. T. J. fCTP 


(f™ 


JCTD) (FBI)i 


I fOGO (FBI); MILLER. WILLIA M A. (OGC) fFBI):f 
IfOGO rFBDi''-' . 


l iTSDif ren ■ 

J(CTD) (FBI) r K NSB) (FBI) 


](OGC) (FBI)[ 


UNCLASSIFIED 

NON-RECORD 




One of the questions today by the President's Civil Liberties Board (PCLB), particularly that of Lannie Davis, 
focused on how and if users are able to nominate documents containing inaccurate information for removal’ and/or 
notify other users of their observations regarding a particular document. What we are talking about in simple 
terms is digital sticky notes" and comments that can be attached or associated with a document that other users 
^n review. This can ajso be used to facilitate and promote collaboration between users. At the bottom of the FD- 
302 we find the words, "The document contains neither recommendations or conclusions of the FBI " ECs cables 
etc. have no such caveats. 

One issue is that the IDW, like the FTTTF data mart, are not systems of records merely aggregate custodians of 
other records. An as such do not contain "original" records not found elsewhere. 

For some time now on the IDW system, we have been collecting the users willingness to "collaborate" their query 
results with others who may have similar interest. Currently, the only ones we export and share oer MOU is when 
they access Financial Crimes Enforcement Network (FinCEN) documents.! 1 


OTHER 0/S 
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G. Clayton Grigg 
Acting Director 

Foreign Terrorist Tracking Task Force (FTTTF) 
Counterterrorism Divisio n (CTD) 


be 

b7C 


(703) 553 
(202) 262 
1877)270 


(Office) 

(Cell/Blackberry) 

lEager) 

_JBIackberry UNCLASS) 


UNCLASSIFIED 

UNCLASSIFIED 


UNCLASSIFIED 
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b7C 


kOGC) (FBI) 


From: 

Sent: 

To: 

b5 


b6 


b7C 


Cc: 


Subject: 


GRIGG, G. CLAYTON (CTD) (FBI) 

Wednesday, October 04, 2006 11:1 5 AM 

KELLEY. PAT RICK W. (OGC1 fFBIll 
A. (O GOfFBI):! IOGCHFBn:l 

(FBI)j irOGCHFBhJ 

I l (CTD)(FBI) j VlTSDIfFBn 


lOGC) (FBI): MILLER WILLIAM 
fOGC) _ 


c 


HARRINGTON, T. T(CTD) 

(NSB1 (FBI! '■ 


□(OGC) (FBI)t 
JCTD) (FBI)C: 


UNCLASSIFIED 

NON-RECORD 





ALL IHFORHATION CONTAIHED 

HEREIN IS UNCLASSIFIED 

DATE 08-27-2007 BY 65179 DHH/BJA/CAL 


One of the questions today by the President's Civil Liberties Board (PCLB), particularly that of Lannie Davis, focused on 
how and if users are able to nominate documents containing inaccurate information for removal and/or notify other users 
of their observations regarding a particular document. What we are talking about in simple terms is "digital sticky notes" 
and comments that can be attached or associated with a document that other users can review. This can also be used to 
facilitate and promote collaboration between users. At the bottom of the FD-302 we find the words. "The document 
contsins neither recommendetions or conclusions of the FBI." ECs, cables, etc. have no such caveats. 


One issue is that the IDW, like the FTTTF data mart, are not systems of records merely aggregate custodians of other 
records. An as such do not contain "original" records not found elsewhere. 


system, we have been collecting the users willingness to "collaborate" their query results 
with others who rray have similar interest. Currently, the only ones we export and share per M Oli is when they access 
Financial Crimes Enforcement Network (FinCEN) documents.' ' 
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loGC) (FBI) 


From; 

Sent: 

To: 

Cc; 


be 

b7C 

b5 


Subject; 


I l (OGC> (FBI) 

Wednesday, October 04, 2006 1:04 PM 

GRIGG. G. C LAYTON tC Tm /FRI) 

I l OGC) (FBI) i 

A. ( OGC) (FBI): KELLEY. PAT RICK W. (OGC) (FBI) 

N I 


lOGC) (FBI); MILLER, WILLIAM 


UNCLASSIFIED 

NON-RECORD 


b5 

b6 

b7C 


ALL IHFOPMATIOH COIOTAIHED 

HEREIN IS UNCLASSIFIED 

DATE 08-27-2007 BY 6S179 DHH/BJA/CAL 


b2 

b6 

b7C 


Jissistant General Counsel 

Privacy a nd Civi l Liberties Unit, Room 7338 

202-324\ \(t>oice) 

202-324 \ V facsimile) 

PRIVILEGED DELIBERATIVE DOCUMENT - NOT FOR DISCLOSURE OUTSIDE THE FBI WITHOUT PRIOR OGC 
APPROVAL 


be 

b7C 

b5 


—Original Message — 


From: 

Sent: 

To: 


Cc: 

Subject: 


GRIGG, G. CLAYTON (CTD) (FBI) 
Wednesday, October 04, 2006 11: 15 AM 
KELLEY, PATRIC K W. lOGCUFBnj 
(OGQ(FBl)j 


iCTD) (FBOL 


iQjjgUPgl) 


Tc OGC) (FBI): MILLER. (FBF 


HARRINGTON. T. I. fCTDl (FBI)| 


•TSb)(FBI) 
l(CTO) (FBI)f 


:OGQ (FBI)[ 


JNSB) (FBI) 


UNCLASSIFIED 

NON-RECORD 


JOGQ (FBI); 


b5 
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One of the questions today by the President's Civil Liberties Board (PCLB), particularly that of Lannie Davis, focused 
on how and if users are able to nominate documents containing inaccurate information for removal and/or notify other 
users of their observations regarding a particular document. What we are talking about in simple terms is "digital 
sticky notes" and comments that can be attached or associated with a document that other users can review. This 
can also be used to facilitate and promote collaboration between users. At the bottom of the FD-302 we find the 
words, "The document contains neither recommendations or conclusions of the FBI." ECs cables etc have no such 
caveats. 


b2 

:b7E 


b5 


b5 


b2 

b7E 


b2 

be 

b7C 


One issue is that the IDW, like the FI I iF data mart, are not systems of records merely aggregate custodians of other 
records. An as such do not contain "original" records not found elsewhere. 



G. Clayton Grigg 
Acting Director 

Task Force (FTTTF) 
(CTD) 


(703) 553-J l(Office) 

(202) 262- (Cell/Blackberry) 

(877) 270- (Pager) 


Foreign Terrorist Tracking 
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